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In 2008, the National Institute of 
Standards and Technology and Energetics 
Incorporated collaborated with the 
International Electrotechnical Commission 
Technical Committee 113 (lEC TC 113) 
on nano-electrotechnologies to survey 
members of the international nanotech- 
nologies community about priorities for 
standards and measurements to accelerate 
innovations in nano-electrotechnologies. 
In this paper, we analyze the 459 survey 
responses from 45 countries as one means 
to begin building a consensus on a 
framework leading to nano-electrotech- 
nologies standards development by 
standards organizations and national 
measurement institutes. The distributions 
of priority rankings from all 459 respon- 
dents are such that there are perceived 
distinctions with statistical confidence 
between the relative international priorities 
for the several items ranked in each of the 
following five Survey category types: 

1) Nano-electrotechnology Properties, 

2) Nano-electrotechnology Taxonomy: 
Products, 3) Nano-electrotechnology 
Taxonomy: Cross-Cutting Technologies, 

4) lEC General Disciphne Areas, and 

5) Stages of the Linear Economic Model. 
The global consensus prioritizations for 
ranked items in the above five category 
types suggest that the lEC TC 113 should 
focus initially on standards and measure- 
ments for electronic and electrical proper- 
ties of sensors and fabrication tools 



that support performance assessments of 
nano-technology enabled sub-assemblies 
used in energy, medical, and computer 
products. 
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1. Introduction 

In this paper, we present the resuhs from a recent 
international Survey to estabhsh priorities for standards 
and measurements involving nano-electrotechnologies. 
We describe the origin and compelling reasons for con- 
ducting the survey; the survey structure and its online 
distribution; the demographics of survey respondents; 
an analysis of the ranking data obtained from the 
Survey; and the major findings. The Survey included 
all stages of the economic cycle for nano-electrotech- 
nology enabled products and systems from research to 
end-of-usefiil life, disposal, and/or recycling. 

Sections 2 and 3 present the background, origin, 
structure, methodology, and demographics for the 
Survey Section 4 contains the statistical details for the 
ranking priorities. Section 5 gives the results of select- 
ed pair-wise correlations. Section 6 contains a summa- 
ry of just the major results and serves as an executive 
summary without statistical details. Appendix A con- 
tains a copy of the Survey as it appeared on the website. 
And finally. Appendix B discusses the statistics and 
formulas on which we base our findings and results 
from the Survey 

1.1 Nanotechnology Defined 

There are many definitions of nanotechnology. The 
definition from the U.S. National Nanotechnology 
Initiative encompasses key aspects included in other 
definitions from around the world. ''Nanotechnology is 
the understanding and control of matter at dimensions 
between approximately 1 and 100 nanometers, where 
unique phenomena enable novel applications. 
Encompassing nanoscale science, engineering, and 
technology, nanotechnology involves imaging, measur- 
ing, modeling, and manipulating matter at this length 

scale Dimensions between approximately 1 and 

100 nanometers are known as the nanoscale. Unusual 
physical, chemical, and biological properties can 
emerge in materials at the nanoscale. These properties 
may differ in important ways from the properties of 
bulk materials and single atoms or molecules.'' [1] 

Nano-electrotechnologies are part of nanotech- 
nology. They are often cross-sectional technologies 
with the potential for many cross-disciplinary applica- 
tions. From the perspective of the International 
Electrotechnical Commission (lEC), nano-electrotech- 
nologies [2] include the following areas at the 
nanoscale: nanostructured sensors; nano-electronics, 
nano-materials and nano-devices; optoelectronics; 



optical materials and devices; organic (opto)-electron- 
ics; magnetic materials and devices; radio frequency 
devices, components and systems; electrodes with 
nanostructured surfaces; electrotechnical properties of 
nanotubes/nano wires; analytical equipment and tech- 
niques for measurement of electrotechnical properties; 
patterning equipment and techniques; masks and 
lithography; performance, durability, and reliability 
assessment for nanoelectronics; fiiel cells; and bio- 
electronic applications. 

1.2 The Standards and Innovation Connection 

Nano-electrotechnologies are expected to be one of 
the key technologies of the 21st century and to provide 
enormous potential for the development of new prod- 
ucts with exceptional performance. Nano-electro- 
technologies will enable society to take advantage of 
economic successes as well as improvements in the 
quality of life by using nano-enabled products. One 
example in healthcare is wireless monitoring of health 
and safety in an aging society, especially for assisted 
living in the home or in facilities. Reliability and dura- 
bility of nano-enabled medical products are great 
challenges because the mainstream nanoelectronics 
industry now often favors performance at the expense 
of reliability and durability [3]. 

International commerce in nano-electrotechnologies 
will require technically valid standards and related 
measurements that are suitable for use in any nation. 
These standards must therefore be developed with input 
from all stakeholders. Effective international standards 
will facilitate wider use of products that offer greater 
fiinctionality or performance through nano-electro- 
technologies-enabled subassemblies. They will also 
enhance the health and safety aspects of products 
for the protection of researchers, manufacturers, 
consumers, and the environment. 

According to a recently published report of 
Semiconductor Equipment and Materials International 
(SEMI) in cooperation with the Semiconductor 
Industry Association (SIA) [4] and by the RNCOS 
Group [5], the materials and equipment market for 
nanoelectronics was US $1.8 billion in 2005 and is 
expected to be US $4.2 billion in 2010. The semicon- 
ductor electronics industry is already a nanotechnology 
industry and will be increasingly important in the 
fiiture. The continued rapid growth of this and other 
nano-electrotechnologies-based industries has required 
increased international standardization activities to 
support equitable and efficient business models. 
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1.3 Role of lEC Technical Committee 113 on 
Nano-Electrotechnologies 

Given the importance of standards to this emerging 
field, the Standardization Management Board of the 
International Electrotechnical Commission (lEC SMB) 
established an Advisory Board on Nanotechnologies 
(SMB ABN 20) in 2005. Based on the recommenda- 
tions from the members of ABN 20, the lEC SMB 
established in May 2006 the lEC Technical Committee 
113 (lEC TC 113) on Nanotechnology Standardization 
for Electrical and Electronic Products and Systems [6]. 
The unofficial short name for lEC TC 113 is Nano- 
electrotechnologies. The lEC TC 113 is interested in 
measurements, terminology characterization, perform- 
ance, reliability durability, environment, health, and 
safety for nano-electrotechnologies. 

The members of lEC TC 1 1 3 developed a list of 
applications for nano-electotechnologies shown below. 
Realizing that such a long list was not suitable for a 
survey, members of the lEC TC 113 Survey Project 
Team fiirther refined the list to minimize overlap 
and created two lists — one for products and one for 
cross-cutting technologies. Each list has 8 items and is 
statistically more suitable for ranking by Survey 
respondents. Sub-section 2.1 Survey Structure and 
Methodology contains the products and cross-cutting 
technologies lists as Category Type 2 and Category 
Type 3, respectively. 

Applications of Nano-Electrotechnologies [6] 

Analytical equipment and techniques for measure- 
ment of electrotechnical properties 
Fabrication tools for integrated circuits (electronic, 
photonics, and optoelectronic) 
Nano-structured sensors 
Nano-electronics, materials and devices 
Optoelectronics 
Optical materials and devices 
Organic (opto) electronics 
Magnetic materials and devices 
Radio frequency devices, components, and systems 
Electrodes with nano-structured surfaces 
Electrotechnical properties of nanotubes/nano wires 
Fuel cells 

Energy storage devices (e.g., batteries) 
Bioelectronic applications 
Nano-enabled solar cells 

The scope of the lEC TC 1 1 3 concerns international 
standardization of those technologies relevant to elec- 



trical and electronic products and systems in the field of 
nanotechnology in close cooperation with other inter- 
national groups working on standards and measure- 
ments for nano-electrotechnologies. These include, for 
example, other lEC committees, the International 
Standards Organization (ISO), the Institute of Electrical 
and Electronics Engineers, Semiconductor Equipment 
and Materials International (SEMI), and the Inter- 
national Technology Roadmap for Semiconductors 
Working Groups. 

The focus of lEC TC 1 1 3 is on those products which 
use nano-electrotechnologies in one or more of their 
subassemblies or during the fabrication process. The 
lEC TC 1 1 3 will produce standards, technical specifi- 
cations and technical reports to guide manufacturers 
and customers in situations where it is necessary to use 
an emerging technology under absence of complete 
knowledge to gain maximum confidence in the life 
cycle performance, reliability and operational safety of 
products. By so doing, the lEC TC 113 seeks to accel- 
erate innovations and commercialization of nano- 
electrotechnologies. 



2. Survey Origin and Development 

Due to the large number of potential applications for 
nano-electrotechnologies and to the TC 113's limited 
resources, there is a need to rank order future standard- 
ization work and make certain that the most important 
standards are developed first. To this end, the TC 1 1 3 
Chairman's Advisory Group (CAG) formed an interna- 
tional TC 113 Survey Project Team. The objective was 
to develop a Survey that would assist in identifying 
those nano-electrotechnology areas relevant to elec- 
tronics and electrical products for which standards are 
critically needed to accelerate innovation. 

The goal of the Survey was to begin building 
consensus among members of the international nano- 
electrotechnologies community on a framework lead- 
ing to standards development. The expectation was that 
responses to the Survey would help prioritize TC 113's 
actions over the next few years. Specific objectives of 
the survey were dictated by the governing principles 
shown in Table 1 . Specifically TC 1 1 3 would like to be 
able to 1) set procedures for ranking proposals and 
associated documents for new work in priority order; 
2) identify members for work groups on standards and 
associated documents; and 3) make informed responses 
to proposals from lEC National Committees. 

This Survey was the first step in developing the lEC 
TC 113 Nanoelectronics Standards Roadmap (INSR). 
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Table 1. Governing Principles for the Survey 

I. Nano-electrotechnologies are very diverse and multi-disciplinary. lEC TC 113 members plan to use the 
Survey to: 

• Build a consensus on key challenges to society for nano-electrotechnology implementation and inter- 
national markets. Possible examples include energy, healthcare, environment, emergency response, 
security, and multimedia communications. 

• Select technologies for responding to new work items proposals on nano-electrotechnology for TC 
113's consideration. 

II. At present, resources are not adequate to address simultaneously all of the fields of interest to TC 113, as 
cited in reference [2]. The members of the CAG decided that mechanical, physical, and thermal properties are 
not of primary focus in this Survey. 

III. According to the lEC mission statement, the standardization efforts of TC 113 may include all electro-tech- 
nologies such as electronics, magnetics and electromagnetics, electroacoustics, multimedia, telecommunication, 
and energy production and distribution, as well as associated general disciplines. 

IV. The linear economic model for innovation in nano-electrotechnologies has six stages ranging from research 
and development to deployment, end use, and disposal or recycling. This linear economic model is a simpHfi- 
cation to make analyzing the Survey responses more tractable. In practice, economic models for innovation and 
commercialization are very complex and non-Hnear with feed-back and feed-forward paths. 



Members of TC 1 1 3 will use the Survey results report- 
ed here as one of the inputs to the INSR that will estab- 
lish a vision of market needs in terms of products, 
available technologies for nano-electrotechnologies 
and standards supporting invention, fabrication and use 
of products over their entire life cycle. The INSR will 
be an lEC integrated roadmap involving the stake- 
holders in the lEC. These stakeholders include the lEC 
National Committees that represent the electro-techni- 
cal industries in their respective countries as well as 
lEC TC 113 liaison organizations like the Institute for 
Electrical and Electronics Engineers (IEEE) and SEMI. 
The INSR will be developed by a newly formed Task 
Group in lEC TC 113 and be pubhshed as a Technical 
Report. The INSR will be revised biannually The offi- 
cers of lEC intend that the INSR will complement other 
publicly available roadmaps such as the International 
Technology Roadmap for Semiconductors (ITRS) and 
the IEEE Nanoelectronics Standards Roadmap. 

2.1 Survey Structure and Methodology 

The authors collaborated with members of the 
lEC TC 1 13 Chairman's Advisory Group (CAG) to pre- 
pare the text for a web-based Survey The Survey was 
designed to determine priority rankings of the needs for 
standards and their supporting measurements that 
should be considered by IECTC113. Appendix A 
contains the full text for the Survey 



Once we completed the text and formats for the out- 
puts from the Survey, the text was converted into 
HTML format for Internet access. SelectSurvey.NET 
version 2.8.7 was used as the platform for the 
on-line Survey, which was on-line from May 10, 2008 
to December 15, 2008 at http://www.energetics.com/ 
lEC-NISTSurvey/index.html. 

The Survey opened with demographic questions that 
had drop down lists for selecting responses: 

1) How would you describe the nature of your 
work in nano-electrotechnologies? 

2) What is the type of institution where you are 
primarily employed? 

3) Please select your country of primary employ- 
ment. 

Note that the country drop-down list contained coun- 
tries that are members of lEC TC 1 13. If a respondent's 
country was not on that list, they were invited to write 
in a country. Section 3 discusses the Survey demo- 
graphics in more detail, including the countries of 
primary employment. 

Survey respondents were then asked to rank in prior- 
ity order the items listed in each of five category types 
from 1 to 77;, where n,- is the number of items in the 
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category type / under consideration and / = 1, 2, . . ., or 5. 
The rank of 1 denotes the highest priority or most 
significant and the rank of rti denotes the lowest 
priority or least significant. The Survey software, 
SelectSurvey.NET 2.8.7, presented each respondent the 
items for a given category type in random order. This 
helped to avoid potential biases in the data that might 
arise if each respondent saw the items to be ranked in the 
same order. The five category types employed in 
the Survey and the relevant Governing Principle from 
Table 1 are as follows: 

1 . Nano-electrotechnology Properties (Governing 
Principle II)(n^ = 6) 

- Electronic and Electrical [Electronic] 

- Optical [Optical] 

- Biological [Biological] 

- Chemical [Chemical] 

- Radio Frequency [Radio] 

- Magnetic [Magnetic] 

2. Nano-electrotechnology Taxonomy: Products 
(Governing Principle I) (n2 = 8) 

- Energy (production, conversion, and storage) 
[Energy] 

- Medical Products [Medical] 

- Computers (PDA and similar, laptop, desktop, 
mainframe) and Computer Peripherals (print- 
ers, monitors/displays, etc.) [Computers] 

- Telecommunication and Data Communications 
(wireless and wired-physical connection) 
[Telecom] 

- Security and Emergency Response Devices 
and Applications [Security] 

- Multimedia Consumer Electronics [Multimedia] 

- Household and Consumer Applications 
[Household] 

- Transportation (sea/water, ground, air, space) 
[Transportation] 

3. Nano-electrotechnology Taxonomy: Cross-Cutting 
Technologies (Governing Principle I) (n^ = 8) 

- Sensors (chemical, physical, mechanical, etc.) 
[Sensors] 

- Fabrication tools for integrated circuits (elec- 
tronic, photonic, optoelectronic, and mechani- 
cal) [Fab. Tools] 

- Nano-electromechanical systems [NEMS] 

- Performance and reliability assessment for 
nanoelectronics [Performance] 



- Analytical equipment and techniques for 
measurements of electro-technical properties 
[Analytic Eq.] 

- Environment, Health, and Safety (EHS) appli- 
cations and effects [EHS] 

- Instrumentation (test equipment and industrial 
process control for use in fabrication) 
[Instrumentation] 

- Optical technologies (optoelectronics and 
illumination) [Optical Tech.] 

4. lEC General Discipline Areas (Governing 
Principle III) (n^ = 6) 

- Measurement and Performance [Measure- 
ment] 

- Design and Development [Design] 

- Health, Safety and Environment (HSE) [HSE] 

- Dependability and Reliability [Dependability] 

- Electromagnetic Compatibility [Compatibility] 

- Terminology, Nomenclature, and Symbols 
[Terminology] 

5. Stages of Economic Model (Governing Principle 
/F)(«5 = 6) 

- Basic Technical Research [Research] 

- Technology Development (prototype develop- 
ment) [Development] 

- Initial deployment [Deployment] 

- Commercialization (large-scale, high-volume 
manufacturing) [Commercialization] 

- End of initial use by the Customers- 
Consumers (End of Initial Usefullness) 
[End-of-Usefullness] 

- End-of-Life (disposing and recycling) 
[End-of-Life] 

The square bracket after each of the above items con- 
tains the abbreviation for that item used in the figures 
that follow in Sees. 4 to 6. 

The international community tends to use different 
orderings of the words environment, health, and safety, 
and hence, different orderings of the letters E, H, and S 
in related acronyms. To distinguish in this paper between 
the Cross-Cutting Technology and the Discipline Area, 
we use the acronym EHS for the Cross-Cutting Technol- 
ogy of Environment, Health, and Safety Applications 
and Effects and the acronym HSE for the lEC General 
Discipline Area of //ea///i. Safety, and Environment. 

After asking respondents to rank the above items in 
priority order, the survey asked them to express their 
interest in volunteering to help the lEC TC 1 1 3 and to 
submit general comments concerning the Survey. 
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2 .2 Survey Advertisements 

Table 2 lists the many organizations that contributed 
to promoting the Survey The officers, editors, and staff 
of the organizations listed therein distributed emails to 
their respective members and/or wrote articles about 
the Survey that invited their members and readers to 
complete the on-line Survey In addition, the Survey 
was advertised at several conferences where those 
attending would be associated in some way with nano- 
electrotechnologies 

These efforts attracted more than 600 respondents 
to the Survey Section 3, Survey Demographics, pro- 
vides a complete breakdown of those actually complet- 
ing the Survey in its entirety. In addition, the Survey 
was open for an extended period (7 months) and re- 
advertised to gain a larger sample size, encourage a 
greater number of participants from more countries, 
and help enhance the statistical credibility of the 
responses and results. The number of completed 
responses increased from 205 in August 2008 to 459 in 
December 2008 — a 223 % increase. 

3. Survey Demographics 

In total, 459 respondents from 45 countries, listed in 
Table 3, volunteered to complete the Survey in its 
entirety Here a complete response is defined as a 



response for which all three of the demographic ques- 
tions and all five of the ranking categories were 
completed. We restrict our analyses to these completed 
responses. As shown in Fig. 1, 44,4 % came from the 
Americas, 29.2 % from Europe, 25.3 % from Asia, and 
1.1 % from the Middle East. 

The respondents self-reported as practicing in coun- 
tries representing most large geographic areas. We do 
not attempt to draw inferences about any of the demo- 
graphic sub-categories as such. For example, we do not 
attempt to weigh demographic sub-categories by 
response rate to achieve a consistent weighting in the 
consensus average. Rather, survey respondents are a 
self-selected group with interests and opinions for 
improving standards and measurements that support 
innovations and commercialization of nano-elec- 
trotechnologies. Their demographic data is used 
primarily for categorical purposes. 

As shown in Figs. 2 and 3, the Survey respondents 
represented a broad cross-section of the nano- 
electrotechnologies community The nature of work 
represented spans technical R&D and management, 
manufacturing, standards development, strategic 
planning, and market analyses. Places of employment 
of respondents included manufacturing companies, 
universities, governments, trade associations, banks, 
standards and metrology organizations, and legal 
organizations. 



Table 2. Organizations contributing to promotion of the Survey 



Email Institute for Electrical and Electronics Engineers (IEEE) Electron Devices Society 

Notifications IEEE Nanotechnology Council (NTC) 

to Members IEEE-Standards Association 

International Technology Roadmap for Semiconductors (ITRS) Working Groups on 

Emerging Research Devices and Emerging Research Materials and Metrology 
International Standards Organization (ISO) Technical Committee 229 on 

Nanotechnologies 
Several ISO and lEC National Committees 

Articles/ Semiconductor Equipment and Materials — Standards Watch, 18 June 2008 

Notices Read http://www.semi.org/cms/groups/public/documents/gg/p044042.htm 

by Members Materials Research Society — Materials 360, Vol. 8, Issue 11, 19 June 2008 (1) 

http://www.mrs.org/s_mrs/doc.asp?CID= 1 926&DID=2 1 4 1 77 
IEEE NTC— Weekly Community Updates, July 2008 
Institute of Physics — ^Nanotechweb, 8 August 2008 

http://nanotechweb.org/cws/article/youmews/35341 
Nano Science and Technology Institute — ^Nano World News, 25 August 2008. 
http://www.nsti.org/news/item.html?id=277 

Exhibit NSTI NanoTech2008 

Booths at SEMICON West 2008 

Conferences ITRS Summer Conference 2008 
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Table 3. Breakdown of Completed Surveys Received by Country 

{Key: (P) indicates a member of TC 113 with participant status; (O) indicates a member of TC 113 with ob- 
server status. The number in square brackets [...] denotes the number of completed Surveys from that country. 
Countries are listed in alphabetical order in each column and from left to right.} 



Argentina (0) [2] 


France (?) [12] 


Mexico (0) [4] 


Austraha (0) [6] 


Germany (?) [32] 


Netherlands (0) [6] 


Austria (0)[1] 


Greece [2] 


?oland (0) [2] 


Bangladesh [1] 


Hong Kong [1] 


Portugal [2] 


Belarus [1] 


Hungary (0) [2] 


Romania [1] 


Belgium [7] 


India (0) [18] 


Russian Federation (?) [4] 


Brazil (0) [4] 


Indonesia (0)[1] 


Singapore (?) [7] 


Canada (P) [17] 


Iran [2] 


Spain (?) [8] 


China [14] 


Ireland [1] 


Sweden (?) [2] 


Colombia [2] 


Israel [1] 


Switzerland [8] 


Croatia [1] 


Italy (?) [22] 


Taiwan [16] 


Czech Republic (0) [1] 


Japan (?) [31] 


Thailand [3] 


Egypt [2] 


Korea (?) [12] 


United Kingdom (?) [16] 


European Union [1] 


Lithuania [1] 


USA(?)[174] 


Finland (P)[l] 


Malaysia (?) [6] 


Venezuela [1] 



1.09% 




29.19% 



Americas (44.44%) Europe (29.19%) 

Middle East (1.09%) Asia (25.27%) 



Fig. 1. Demographics of Survey Respondents. 
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4.14% 



1.11% 




2.61% 



I Technical R&D (51.42%) 

I Technical Manufacturing (2.61%) 

■ Management of R&D (2D.04%) 

^ Management of Manufacturing (1.31%) 

M standards Devefoper, Administrator, 
or Director (S.28%) 

Strateg ic PJanr er a nd Market Ana lyst {4.1 4%) 
Other(12,20%) 



The largest categories represented in the nature of 
work were both research-related: Technical R&D and 
Management of R&D. This is largely indicative of the 
emerging nature of nanotechnology and the significant 
amount of research and development ongoing in this 
field. While new products are emerging regularly 
many others are still in the early development and 
proof-of-concept phases. 

The largest percent of respondents were from uni- 
versities, followed by those from manufacturing com- 
panies and a significant number from research institu- 
tions. This reflects a strong research and develop- 
ment focus in the field of nanotechnology as well as 
significant interest in new product development and 
manufacture. 

The small percentage, about 3 %, of respondents 
from metrology organizations and standards develop- 
ment organizations could indicate that the majority of 
responders were users of measurement technology, 
either for research or product development. A more 
significant portion of respondents, about 14 %, came 
from government and non-profits. 



Fig. 2. Distribution of Survey Respondents: Nature of Worlc. 




'omV '-^ 



y.m 



3zjmt 



B Manufacturing Company (23.63%) 
P University {3246%) 
I Government (€.32%) 

■ Trade Association {1.31%} 
I Investment Bank (0.44%) 

■ Metrology Organization (0.&7%] 

B Standards Developing Organization {1.96%| 
B Legai Organization (1.09%) 
H Non-Profit Organization (5.01%) 

■ Research institution {t 1.98%) 
Other (8.93%) 



Fig. 3. Distribution of Survey Respondents: Place of Employment. 



4. Priorities Analysis 

One of the primary goals of the survey was to deter- 
mine a consensus prioritization among the items listed 
for each of the category types. With this goal in mind, 
the Survey required the respondents to rank all items 
for each of the five category types, with no ties 
allowed. Tallying the results from all respondents pro- 
vides a priority rank distribution in a given category 
type. In this analysis, we consider the distributions 
based on all respondents, but do not consider various 
demographic sub-categories. 

Considering the sample size and the statistical nature 
of the distributions of responses, especially since some 
distributions were strongly bimodal, we do not give the 
precise rank importance of each and every item includ- 
ed in the Survey. Instead, we introduce a coarser analy- 
sis in which we place subsets of the Survey items into 
sub-groups and then rank the sub-groups in priority 
order. This coarser analysis is an alternative procedure 
described in more detail in the recent Analysis oflSCD- 
NIST Survey for Bone Health [7]. We find that this 
sub-grouping of Survey items offers a prioritization 
scheme that is reasonably consistent across several 
Survey categories. 
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4.1 Ordinal Statistics and Concordance 

In this section, we present preliminary statistical 
analyses. As noted above, we restrict the discussions to 
results treating all respondents as a single group. 
Figures 4 through 8 provide histograms of the vote 
(ballot) distributions from all Survey respondents for 



each of the five category types. In each figure, each of 
the «, items to be ranked in that category type has n^bars 
associated with it. The first bar on the left is the num- 
ber of respondents who gave that item a rank of 1 . The 
next bar is the number of respondents who gave that 
item a rank of 2, and so forth. A rank of 1 indicates the 
highest priority and a rank of n^ is the lowest priority. 
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Fig. 8. Rank Distribution of Stages of the Economic Model. 



Figures 9 through 13 give the medians, first quartiles, 
third quartiles, and 95 % confidence intervals (CI) for 
each of the priority ranked items in the five category 
types. Appendix B contains the formula given by 
Eq. (B. 1) that we use for computing the 95 % CI values, 
i.e., the uncertainty in the median estimate. The use 
of median as a measure of central tendency, as opposed 
to mean, is more appropriate for the ordinal nature of the 
rank data [8]. 

In each of these 5 figures, we give the n, category type 
/ items in sorted order, with the left most item considered 
to be the most important. The thick-horizontal lines in 
the vertically-oriented shaded boxes indicate the median 
values. The vertical extents of the larger shaded boxes 
correspond to the first and third quartiles. The vertical 
extents of the smaller boxes inside the larger shaded 
boxes indicate the 95 % confidence intervals for the 
uncertainty estimate of the median as computed by 
Eq. (B. 1) in Appendix B. 

We computed Friedman's statistic to assess the degree 
of distinction between items. Our analysis follows 
Lehmann [9] and details are provided in Appendix B. 
Friedman's statistic is designed to test the null hypo- 
thesis, namely 

Hq = "Voters-respondents randomly assigned 
ranks to the items with equal probability." 



In other words, when Hq is true, then the distribution 
of votes reflects no discernible preference among items. 
To test Hq, we compute Friedman's statistic Q according 
to Eq. (B.2) in Appendix B and compare the value 
against the null distribution by way of the confidence 
jt?-value. One interpretation of the j9-value in relation to 
an observed value, Q^^,, is that if //q were true, then one 
would expect a value of Q greater than or equal to Q^^, 
with probability/?. 

We use Eq. B.4 in Appendix B to compute the j9- value. 
We find that for all respondents we can reject Hq with 
more than 99 % confidence (jt? < 0.01). Such a conclu- 
sion is consistent with the observation that the estimates 
of the median ranks for all of the items, e.g.. Fig. 1 1, are 
such that the 95 % confidence intervals (B.l) for all rii 
items do not overlap. This lack of overlap provides 
evidence that there are perceived differences among the 
77/ items. The exceptions to this are likely to be when the 
conditions given in Appendix B are not met. 

In summary, although the histogram plots such as 
that shown in Figs. 4 through 8 do not reveal obvious 
structure, the distributions of ranks suggest that it is 
unlikely that they were assigned randomly with equal 
preference to all items. We discuss our strategy for 
determining global consensus ranks in the next sub- 
section. 
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Tables 4 through 8 show the consensus priorities for 
each of the five category types as determined by a 
traditionally weighted scoring technique called the 
Borda count [10]. Applying this procedure to the pres- 
ent Survey category types we assign the following 
score- weights: the first-placed items (highest priority 
or most significant) on every ballot receive scores of «„ 
the second-placed items receive scores of «,- 1, and so 
forth, until the lowest priority or least significant items 
on the ballot receive scores of 1 . We assign the scores 
to each ballot individually, and then sum over all ballots 
within the category type of interest. We rank the items 
in descending order by the Borda score, i.e., the highest 
score is the "winner." In short, the Borda score is a 



weighted mean with a particular assignment of weights 
to ballot positions. We refer throughout this paper to 
these Borda count orderings as the "global consensus" 
orderings. 

The global consensus order may not be the same as 
the order when only rank 1 votes are considered. For 
example, Fabrication Tools in Table 6 received 109 
rank 1 votes, 61 rank 2 votes,..., and 44 rank 8 votes. 
All of the remaining 7 items in Table 6 received fewer 
than 109 rank 1 votes. We estimate the median rank of 
the underlying random variable to be 3 ± 0.29. The 
global consensus is that Fabrication Tools is second to 
Sensor as a priority activity for lEC TC 1 13 to promote 
nano-electrotechnologies. 



Table 4. Consensus Priority Rankings for Properties 









Raw Data 










Global 
















Median and 


Borda 


Consensus 


















Rankl 


Rank 2 


Rank 3 


Rank 4 


Rank 5 


Rank 6 


95 % CI 


Score 


Rank 


Electronic and Electrical 


292 


57 


58 


26 


13 


13 


1 (± 0.07) 


2,386 


1 


Optical 


17 


115 


112 


105 


78 


32 


3 (±0.15) 


1,628 


2 


Biological 


68 


73 


68 


75 


77 


98 


4 (± 0.22) 


1,522 


3 


Chemical 


37 


86 


70 


68 


113 


85 


4 (± 0.22) 


1,447 


4 


Radio Frequency 


34 


83 


69 


78 


63 


132 


4 (± 0.29) 


1,387 


5 


Magnetic 


11 


45 


82 


107 


115 


99 


4 (±0.15) 


1,269 


6 
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Table 5. Consensus Priority Rankings for Products 











Raw Data 








Median and 
95 % CI 


Borda 
Score 


Global 
Consensus 
Rank 




Rankl 


Rank 2 


Rank 3 


Rank 4 


Rank 5 


Rank 6 


Rank 7 


Rank 8 


Energy 


130 


94 


69 


52 


34 


37 


18 


25 


3 (± 0.22) 


2,680 


1 


Medical Products 


85 


103 


85 


57 


41 


45 


26 


17 


3 (±0.22) 


2,564 


2 


Computers 


109 


63 


60 


59 


57 


52 


31 


28 


3 (± 0.22) 


2,442 


3 


Telecommunication 


57 


82 


72 


89 


72 


43 


29 


15 


4 (± 0.22) 


2,397 


4 


Security and Emergency 
Response 


25 


43 


62 


67 


75 


77 


51 


59 


5 (± 0.22) 


1,900 


5 


Multimedia Consumer 
Electronics 


22 


39 


47 


59 


72 


65 


83 


72 


5 (± 0.22) 


1,747 


6 


Household and Consumei 
Applications 


- 20 


12 


39 


30 


47 


76 


119 


116 


7 (± 0.22) 


1,398 


7 


Transportation 


11 


23 


25 


46 


61 


64 


192 


127 


6 (±0.22) 


1,396 


8 



Table 6. Consensus Priority Rankings for Cross-Cutting Technologies 











Raw Data 












Global 




















Median and 


Borda 


Consensus 




Rankl 


Rank 2 


Rank 3 


Rank 4 


Rank 5 


Rank 6 


Rank 7 


Rank 8 


95 % CI 


Score 


Rank 


Sensors 


100 


94 


60 


49 


51 


45 


34 


26 


3 (± 0.22) 


2,496 


1 


Fabrication Tools 


109 


61 


66 


52 


47 


40 


40 


44 


3 (±0.29) 


2,387 


2 


Nano-electromechanical 


59 


71 


59 


58 


65 


45 


46 


56 


4 (± 0.29) 


2,156 


3 


Systems 
























Performance Assessment 


55 


54 


58 


57 


57 


61 


60 


57 


5 (±0.29) 


2,039 


4 


Analytical Equipment 


30 


57 


54 


70 


80 


74 


58 


36 


5 (± 0.22) 


2,007 


5 


EHS 


71 


40 


45 


39 


48 


54 


66 


96 


5 (± 0.29) 


1,895 


6 


Instrumentation 


13 


39 


58 


73 


60 


71 


84 


61 


5 (± 0.22) 


1,772 


7 


Optical Technologies 


22 


43 


59 


61 


51 


69 


71 


83 


5 (± 0.29) 


1,772 


8 



Table 7. Consensus Priority Rankings for General Disciphne Areas 



Raw Data 



Rank 1 Rank 2 Rank 3 Rank 4 Rank 5 Rank 6 



Median and 
95 % CI 



Borda 
Score 



Global 

Consensus 

Rank 



Measurement and 
Performance 


90 


143 


103 


64 


43 


16 


2 (±0.15) 


Design and Development 


137 


76 


77 


68 


59 


42 


3 (± 0.22) 


Health, Safety, and 
Environment 


129 


60 


68 


67 


65 


70 


3 (± 0.29) 


Dependability and 
Reliabihty 


51 


94 


106 


111 


67 


30 


3 (±0.15) 


Electromagnetic 
Compatibility 


18 


46 


60 


91 


154 


90 


5 (±0.15) 


Terminology and Symbols 


34 


40 


45 


58 


71 


211 


5 (± 0.22) 



1,961 

1,874 
1,747 

1,697 

1,249 

1,111 
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Table 8. Consensus Priority Rankings 


for Economic Stages 






















Raw Data 










Global 
















Median and 
95 % CI 


Borda 
Score 


Consensus 
Rank 




Rankl 


Rank 2 


Rank 3 


Rank 4 


Rank 5 


Rank 6 


Basic Technical Research 


204 


63 


57 


47 


30 


58 


2 (± 0.22) 


2,026 


1 


Technology Development 


96 


160 


84 


59 


45 


15 


2 (±0.15) 


1,994 


2 


Initial Deployment 


34 


65 


112 


100 


97 


51 


4 (±0.15) 


1,522 


3 


Commercialization 


52 


66 


81 


108 


70 


82 


4 (± 0.22) 


1,512 


4 


End-use by the 


48 


47 


63 


67 


133 


101 


5 (±0.15 


1,343 


5 


Customer-Consumer 




















End-of-Life 


25 


58 


62 


78 


84 


152 


5 (± 0.22) 


1,242 


6 



4.2 Rank Prioritizations 

Aggregating a collection of rankings to determine a 
consensus rank is a well-known problem in voting and 
social choice theory [10,11]. There are several compet- 
ing algorithms and there is no clear "optimal strategy" 
among them. As discussed in the previous paragraphs, 
we select a traditional positional weighting scheme 
referred to as a Borda method. We emphasize that both 
the choice of a positional scoring method, and sub- 
sequently the selection of weights to be applied, can 
affect the results. For example returning to Table 6, 
whereas the Fabrication Tools receives the most rank 1 
votes, the Borda scoring scheme values the relatively 
large number of second and third place votes received 
by Sensors to the extent that the latter edges out the 
former. One could envision alternative weighting 
schemes that allocates higher value to first-placed 
ranks relative to the middle-placed ranks than does the 
arithmetic sequence /2„ /2,- 1, ,,,,, 1, For example, in 
such cases the consensus prioritization between 
Fabrication Tools and Sensors could transpose. 

The final prioritizations in their every detail are not 
very precise. However, slightly coarser analyses sug- 
gest themselves as being possible and agreeable to all 
respondents. In this re-factoring or re-grouping of the n, 
items in each category type /, we rank sub-groups of 
items for each category type by their respective median 
values and then order the items within a sub-group by 
their respective Borda global consensus count order. 
We list the highest priority category type sub-group 
first in the following prioritizations: 

1) Properties (Figure 9 and Table 4) 

Sub-Group 1 - Electronic and Electrical 
Sub-Group 2 - Optical 

Sub-Group 3 - Biological; Chemical; Radio 
Frequency; and Magnetic 



2) Products (Figure 1 and Table 5) 

Sub-Group 1 - Energy; Medical Products; and 



Telecommunications 
Security and 
and Multimedia 



Computers 
Sub-Group 2 - 
Sub-Group 3 

Response 

Electronics 
Sub-Group 4 

Applications 
Sub-Group 5 - Transportation 



Emergency 
Consumer 



Household and Consumer 



3) Cross-Cutting Technologies (Figure 11 and Table 6) 

Sub-Group 1 - Sensors and Fabrication Tools 
Sub-Group 2 - Nano-electromechanical 

Systems 
Sub-Group 3 - Performance Assessment, 

Analytical Equipment; EHS; Instrumentation; 

and Optical Technologies 

4) Discipline Areas (Figure 12 and Table 7) 

Sub-Group 1 - Measurement and Performance 
Sub-Group 2 - Design and Development; HSE; 

and Dependability and Reliability 
Sub-Group 3 - Electromagnetic Compatibility 

and Terminology and Symbols 

5) Stages of the Linear Economic Model (Figure 13 and 
Table 8) 

Sub-Group 1 - Basic Technical Research and 
Technology Development 

Sub-Group 2 - Initial Deployment and Commer- 
cialization 

Sub-Group 3 - End-use by the Customer- 
Consumer and End-of-Life 

The above five prioritizations suggest that 
lEC TC 1 1 3 should focus in the short-term on 
standards and measurements for electronic and 
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electrical properties of sensors and fabrication tools 
that support performance assessments and measure- 
ments of nano-technology sub-assemblies used in 
energy, medical, and computer products. 



5. Correlations Analysis 



Figures 14 through 27 show the correlation results 
for the following comparisons: 

• Products: Energy, Computers, Medical and 
Telecommunication and Data Communications 
versus Cross-Cutting Technologies (Figs. 14 to 
17) 



Any correlation analyses among the several items in 
the five category types (Properties, Products, Cross- 
Cutting Technologies, Discipline Areas, and Stages of 
the Linear Economic Model) and in the three demo- 
graphic items (Country-region, Nature of Work, and 
Employment Institution) should meet the validity con- 
ditions given in Appendix B. Specifically the validity 
conditions include: 1) a large enough sample size, 
^ sample :> 2) a Small cuough Kendall's W, and 3) a vanish- 
ingly small confidence /?-value. Our approach for 
deciding which correlations are likely to satisfy the 
above validity conditions begins by correlating those 
items that have a large enough number of ranked 1 
votes within a category type with all of the items in 
another category type. For example, among the eight 
items in the category type Products, Energy received 
the most rank 1 votes, namely 130. Computers and 
Medical Products with rank 1 votes of 109 and 85, 
respectively, followed Energy. Figure 14 then shows 
how the 130 Energy respondents ranked the 8 items in 
the category type Cross-Cutting Technologies. 



General Discipline Area: Design and Devel- 
opment, Health, Safety, and Environment (HSE), 
and Measurement and Performance versus 
Products (Figs. 18 to 20) 

General Discipline Area: Design and Devel- 
opment, Health, Safety, and Environment (HSE), 
and Measurement and Performance versus 
Cross-Cutting Technologies (Figs. 21 to 23) 

Nature of Work: Technical R&D and Manage- 
ment R&D versus Stages of the Economic Model 
(Figs. 24 and 25) 



• Employment Institution: Universities and Manu- 
facturing Companies versus Cross-Cutting 
Technologies (Figs. 26 and 27). 

The confidence jt?- values failed to approach zero for 
two of the correlations that we considered: 1) Nature 



Correlation of Energy vs. Cross-Cutting Technologies 
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Correlation of Computers vs. Cross-Cutting Teclinologies 
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Correlation of Telecommunication and Data Communications vs. Cross-Cutting Teclinologies 
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Correlation of Health, Safety, and Environment (HSE) vs. Products 
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Correlation of Design and Development vs. Cross-Cutting Teclinoiogies 
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Correlation of Health, Safety, and Environment (HSE) vs. Cross-Cutting Teclinoiogies 
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Correlation of Measurement and Performance vs. Cross-Cutting Teciinoiogies 




Fig. 23 



Correlation of Technical R&D vs. Stages of tlie Economic Modei 
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Correlation of Management R&D vs. Stages of the Economic l\1odei 
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Correlation of Manufacturing Companies vs. Cross-Cutting Teclinoiogies 




195'S^CI ^ 'Quartltes 



= Median 



PF 




{N=136; W=O.067S; Q=^64.06; p-^0) 



^- 






x^ 



..-^ 



# 



^ 



y N^-"" 

• o/ 



# 



Cro^s-Cutting Tectinoiogies 



Fig. 27 



of Work: Standards Developer, Administrator, or 
Director of R&D versus Stages of the Economic Model 
and 2) Employment Institution: Research Institutions 
versus Cross-Cutting Technologies. The p-values for 
these two correlations indicate that the sample sizes 
may not be large enough for acceptable statistical 
analyses. The distributions of rankings in this Survey 
suggest that the validity conditions may not be met in 
correlations with samples sizes less than about 85. 

Comparing the correlation rankings given in Figs. 14 
to 27 reveals many transpositions of priority rankings. 
An interesting result is that the bimodal distribution 
of item Cross-Cutting Technologies: Environment, 
Health, and Safety (EHS) Applications and Effects that 
appears in Fig. 6 and Table 6 is further supported by 
correlations. In statistics, a bimodal distribution is a 
probability distribution with two different modes (e.g., 
peaks or values) that occur more frequently than 
neighboring values. As shown in Fig. 15, Products: 
Computers versus Cross-Cutting Technologies, the 
item EHS Applications and Effects ranks last in 



priority. Whereas in the correlation shown in Fig. 16, 
Products: Medical Products versus Cross-Cutting 
Technologies, the item EHS Applications and Effects 
ranks first in priority. 

The bimodal distribution of the Cross-Cutting 
Technologies item EHS Applications and Effects 
demonstrates what we might expect: from a medical 
products viewpoint. Environment, Health and Safety 
are of paramount importance; from the viewpoint of a 
manufacturer of computers, the issues that directly 
affect production (fabrication of circuits, sensors, 
performance, and reliability) are of most importance. 
Table 9 illustrates the statistical results that support 
evidence of the bimodal distribution. Additionally, 
while the lEC Discipline Area item of Health, Safety 
and Environment in general appears to be important 
across many groups, it is less important than some of 
the disciplines relevant to earlier stages of the product 
cycle (e.g.. Design and Development) and production 
stages (Measurement and Performance). 
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Table 9. Survey Results Relevant to a Bimodal Distribution for Crosscutting Technology: EHS Applications and Effects 



Survey Results 



Rankings 



Rank Data — Cross-Cutting Technologies 
(Table 6) 

Priority Ranking for General Discipline Area: Health, Safety, 
and Environment (Fig. 7). 

Correlation for General Discipline Area: Health, Safety and 
Environment versus Cross-Cutting Technologies (Fig. 22) 

Correlation for Products: Medical versus Cross-Cutting 
Technology (Fig. 16) 

Correlation for Products: Energy versus Cross-Cutting Technology 
(Fig. 14 ) 

Correlation for Place of Employment: Universities versus 
Cross-Cutting Technologies (Fig. 26) 

Correlation for Products: Computers versus Cross-Cutting 
Technology (Fig. 15 ) 

Correlation for Products: Telecommunication and Data 
Communications versus Cross-Cutting Technology (Fig. 17) 

Correlation for General Discipline Area: Design and Development 
versus Cross-Cutting Technologies (Fig. 21) 

Correlation for General Discipline Area: Measurement and 
Performance versus Cross-cutting Technologies (Fig. 23) 

Correlation for Place of Employment: Manufacturing 
Companies versus Cross-Cutting Technologies (Fig. 27) 



Significant number of votes for both high rank and low rank 
(bimodal) 

Large number of votes for rank 1; general population supports 
it as a priority (not bimodal) 

Majority ranked EHS Applications and Effects first. 



Majority ranked EHS Applications and Effects first. 



EHS Applications and Effects ranked in the next to the last 
sub-group or tier. 

EHS Applications and Effects ranked in the next to the last 
sub-group or tier. 

Majority ranked EHS Applications and Effects last. 



Majority ranked EHS Applications and Effects last. 



Majority ranked EHS Applications and Effects last. 



Majority ranked EHS Applications and Effects last. 



Majority ranked EHS Applications and Effects last. 



Figures 24 and 25 illustrate the correlation of the 
largest number of responders in terms of nature of work 
(Technical R&D and Management R&D) versus the 
Stages of the Economic Model. Both groups of respon- 
dents indicated that Basic Technical Research and 
Technology Development were among their top ranked 
Stage of the Economic Model, with less emphasis placed 
on the stages related to technology Commercialization 
and Initial Deployment. This is indicative of the nature 
of the respondent demographic — over 70 % of respon- 
dents were listed as being in Technical R&D or 
Management of R&D positions (Fig. 2). 

In Figs. 26 and 27, the correlation between the largest 
number of responders in employment institutions 
(Universities and Manufacturing Companies) versus 
Cross-Cutting Technologies illustrates both institution 
types have a keen interest in Sensors, Fabrication Tools 
for Integrated Circuits, and Nano-electromechanical 
Systems. In general across all the correlations. Sensors 



and Fabrication Tools for Integrated Circuits were 
ranked among the first three choices, regardless of 
category. The correlations as a result support the over- 
all conclusion that the lEC TC 113 should focus initial- 
ly on standards and measurements for electronic and 
electrical properties of sensors and fabrication tools. 

6. Conclusions 

Our analyses suggest that the majority of the 459 
respondents agree with the following statements: 

1) The most important items on which lEC TC 113 
should work are those items included in the 
Sub-Groups 1 for each of the category types listed 
in the Ranked Prioritizations Sub-Section; namely. 
Electronic and Electrical properties of Sensors and 
Fabrication Tools used to manufacture Medical, 
Computer, and Energy products. 
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2) Because the time frame of the Survey was the short- 
term, the critical disciphne areas for lEC TC 113 
technical experts will be initially Measurements 
and Performance assessments that include metrics 
for determining reliability and durability of nano- 
electrotechnology enabled products and systems. 

3) lEC TC 113 members should focus their work ini- 
tially on those standards and measurements that 
contribute to advances in the economic stages of 
Technical Research and Technology Development 
related to the fabrication of nano-electrotechnology 
enabled products and systems. 

The Survey respondents as a whole do not agree on 
the relative importance of the Cross-Cutting Technology 
item EHS Applications and Effects. Almost as many 
respondents said that EHS Applications and Effects were 
most important as said that they were least important 
from among the eight items listed for Cross-Cutting 
Technologies. Furthermore, those respondents who said 
Medical products were most important also said EHS 
Applications and Effects were most important. Whereas, 
those who said Energy, Computer, and Telecommun- 
ication and Data Communications products were most 
important said EHS Applications and Effects were least 
important. This apparent dependence of the relative 
importance of EHS Applications and Effects on specific 
products requires consideration in the INSR and may 
warrant additional investigations. 



The data samples for correlations of Cross-Cutting 
Technology: EHS Applications and Effects with the 
remaining four Product items Security and Emergency 
Response Devices, Multimedia Consumer Electronics, 
Household and Consumer Applications, and Transport- 
ation are such that the respective 95 % Confidence 
Intervals are too large and thereby do not allow us to 
reach statistically defensible statements. Combining the 
major results from Figs. 14 to 17, we use the schematic 
in Fig. 28 to show graphically the above dependence for 
the four Product items that have acceptable 95 % 
Confidence Intervals. Namely, the 71 respondents who 
gave EHS Applications and Effects the highest priority 
assigned highest priority to Medical Products. We order 
for the figures that follow, beginning with Fig. 28, the 
ranked items in ascending Borda rank. The item at the 
top has the highest priority rank and the item at the 
bottom has the lowest priority rank. 

Figures 29 and 30 summarize respectively the correla- 
tions of the Discipline Area item Health, Safety and 
Environment and the Cross-Cutting Technology item 
EHS Application and Effects with the stages of the 
Economic Model. The 129 respondents who ranked the 
Discipline Area item Health, Safety and Environment 
the highest and the 71 respondents who ranked the 
Cross-Cutting Technology item EHS Application and 
Effect the highest assigned the highest priorities to the 
Economic Model stages of Basic Technical Research 
and Techno-logy Development and the lowest priority to 
Commercialization. 



Higher Priority EHS vs. Products Correlation Lower Priority 



EHS AppUcations and Effects 



Medical 



Energy 



Telecomm unica tions 



Computers 



Fig. 28. Schematic of the correlation of the relative importance of Cross-Cutting Technology 
item EHS AppUcations and Effects with four of the eight Product items. 
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Higher Priority 



HSE vs. Stages of Economic 
Model Correlation 



Lower Priority 



Health, SafQty, and Environment 



D&v&iopment 



R&search 



End-of-UtB 



Depioyment 



End^f'Usefulness 



Gommerc'tattaUon 



Fig. 29. Schematic of the correlation of the relative importance of Discipline Area item 
Health, Safety, and Environment with the Economic Model stages. 



Higlier Priority 



EHS vs. Stages af Economic 
Model CorrelatloTi 



Lowver Priodiy 



EHSAppticathns and Effects 



Research 



D&v&hpment 



D&pfaym&nt 



1 



End-of-Usefutness 



End-of-Lffe 



CommBrciaSizathn 



Fig. 30. Schematic of the correlation of the relative importance of Cross -Cutting 
Technology item EHS Applications and Effects with the Economic Model stages. 
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Finally, Figs. 31 and 32 summarize respectively the 
correlation of the Products item Medical Products with 



Cross-Cutting Technologies and the correlation of the 
Cross-Cutting Technologies item Sensors with Products. 



Higher Priority Wed/cffJPTOdi/cte V5. Crpss-Cutting ^^^,^,.^^^^ 
TechnQlogies Correlation 



Medical Products 



EHS 



Sensors 



Fab. Tools 



I 



Anaiyth Eq. 



I 



Rerfonnunoe 



I 



NEKS 



i 



Instrumentation 



Opticat Tech^ 



Fig. 31. Schematic of the correlation of the relative importance of Products item Medical 
Products with the Cross-Cutting Technologies category. 



Higher Priority 



Sensors vs. Products 
Correlation 



Sensors 



Energy 



Medical 



TeleGfymnrvnicB tions 



I 



Computers 



Security 



Lower Priority 



Mut^media 



Transportation 



Househoid 



Fig. 32. Schematic of the correlation of the relative importance of Cross-Cutting Technology 
item Sensors with the Products category. 
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The 85 respondents who ranked the Products item 
Medical Products the highest assigned the highest 
priorities to the Cross-Cutting Technologies EHS 
Applications and Effects and Sensors. The 100 respon- 
dents who ranked the Cross-Cutting Technology item 
Sensors the highest assigned the highest priorities to 
Energy and Medical Products. Combining these two sets 
of correlation figures for Medical Products and Sensors 
suggests a consensus among many respondents 
that standards and measurements for bio-sensors 
enabled by nano-electrotechnologies have very high 
priorities. 

We intended that this broadly-based Survey ehcit the 
views of the nano-electrotechnologies community as to 
ways for advancing innovations and commerciahza- 
tion. The goals of this survey were to determine the 
extent of consensus from the nano-electrotechnologies 
community around the four governing principles listed 
previously. From the survey, we surmise that the 
lEC TC 113 should focus initially on R&D standards 
and measurements for electronic and electrical proper- 
ties of sensors and fabrication tools that support 
performance assessments of nano-technology enabled 
sub-assemblies used in energy, medical, and computer 
products. 

Our general conclusions from the foregoing analyses 
are: 

1) To increase confidence in the ranked Survey 
items, we may arrange them, as follows, in sub- 
groups based on median ranks for each of the five 
category types. 

Properties (Fig. 9 and Table 4) 

Sub-Group 1 - Electronic and Electrical 
Sub-Group 2 - Optical 
Sub-Group 3 - Biological; Chemical; Radio 
Frequency; and Magnetic 

Products (Fig. 10 and Table 5) 

Sub-Group 1 - Energy; Medical Products', 

and Computers 
Sub-Group 2 - Telecommunications 
Sub-Group 3 - Security and Emergency 

Response and Multimedia 

Consumer Electronics 
Sub-Group 4 - Household and Consumer 

Applications 
Sub-Group 5 - Transportation 



Cross-Cutting Technologies (Fig. 11 and Table 6) 
Sub-Group 1 - Sensors and Fabrication 

Tools 
Sub-Group 2 - Nano-electromechanical 

Systems 
Sub-Group 3 - Performance Assessment; 
Analytical Equipment; 
EHS; Instrumentation; and 
Optical Technologies 

Discipline Areas (Fig. 12 and Table 7) 
Sub-Group 1 - Measurement and Per- 
formance 
Sub-Group 2 - Design and Development; 
HSE; and Dependability 
and Reliability 
Sub-Group 3 - Electromagnetic Compati- 
bility and Terminology and 
Symbols 

Stages of the Linear Economic Model (Fig. 13 

and Table 8) 

Sub-Group 1 - Basic Technical Research 

and Technology Development 

Sub-Group 2 - Initial Deployment and 

Commercialization 
Sub-Group 3 - End-use by the Customer- 
Consumer and End-of-Life 

2) Even though the ordering of individual items may 
change by choice of analysis procedure, we find 
that the above sub-groupings of the Survey items 
and their ordering based on the Borda global rank 
in Tables 4 to 8 within a median sub-group largely 
reflect the consensus of the multifaceted and inter- 
national nano-electrotechnologies community of 
stakeholders. 

The raw data from the Survey presented in Tables 4 
through 8 are available as Microsoft Excel files. 
Subject to satisfying all of the criteria given in 
Appendix B, other analyses and correlations than those 
presented in the foregoing sections may be useful. The 
authors welcome suggestions and possible collabora- 
tions. Interested readers should send an email to the 
first author at herbert.bennett@nist.gov. 
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Appendix A: Survey Text 

lEC TC113 NANO-ELECTROTECHNOLOGY 
SURVEY to establish priorities for standards devel- 
opment and measurements for electrical and elec- 
tronic products and systems 

About us 

In 2006, the International Electrotechnical 
Commission (lEC) http://www.iec.ch/ estabhshed the 
Technical Committee 113 (TC 113) on Nanotechnology 
standardization for electrical and electronic products 
and systems (Nano-electrotechnology). The TC 113 
Chairman's Advisory Group (CAG) formed an inter- 
national TC 113 Survey Project Team to prepare this 
survey. The results from this survey will be used by the 
TC 113 to assist in identifying those nanotechnology 
areas for which standards are critically needed to 
accelerate innovation. 

In its role to support international standards develop- 
ment for nano-electrotechnology, the Electronics and 
Electrical Engineering Laboratory (EEEL) at the 
U.S. National Institute of Standards and Technology 
(NIST) has contracted with Energetics Incorporated 
http://www.energetics.com/ to conduct, analyze, and 
report on the survey results. NIST is the national 
measurement institute (NMI) for the U.S. and has a 
strong interest in understanding measurement priorities 
in this field. The U.S. Government offers the following 
notice about surveys that it is conducting or that it is 
funding others to conduct: 

Paperwork Reduction Act 

This survey contains collection of information 
requirements subject to the U.S. Paperwork Reduction 
Act. Notwithstanding any other provisions of the law, no 
person is required to respond to, nor shall any person be 
subject to penalty for failure to comply with, a collection 
of information subject to the requirements of the 
Paperwork Reduction Act. The estimated response time 
for this survey is 8 minutes. The response time includes 
the time for reviewing instructions, searching existing 
data sources, gathering and maintaining the data needed, 
and completing and reviewing the collection of informa- 
tion. Please send comments regarding this estimate or 
any other aspects of this collection of information, 
including suggestions for reducing the length of this 
questionnaire, to the National Institute of Standards and 



Technology, Herbert Bennett, TC113Survey@nist.gov. 
The U.S. Office of Management and Budget (0MB) 
number for this survey is 0MB 0693-0033, expiring on 

7/31/2009. 

SIDEBAR every page: For more information on the 
conduct, design, or outcome of this survey, please 
contact TC 113 Survey Webmaster@energetics.com 

Goals and Objectives 

Recently, the International Electrotechnical Com- 
mission (lEC) http ://w WW. iec . ch/ established the 
Technical Committee 113 (TC 113) on Nanotechnology 
standardization for electrical and electronic products and 
systems (Nano-electrotechnology). The committee was 
created to identify and help address the future needs for 
standards for nanotechnology relevant to nano- 
electrotechnology. TC 113 has a membership of 26 
countries, of which 15 are participating countries from 
four continents. 

Due to the potentially wide application of nano- 
electrotechnology, the TC 113 has a need to prioritize 
future standardization work to make sure that the most 
important standards are developed first. The Technical 
Committee members will use this Survey to assist in 
identifying those nanotechnology areas relevant to elec- 
tronics and electrical products for which standards are 
critically needed to accelerate innovation. 

Your input is critical to the TC 113 process. Your 
survey responses will help prioritize the TC 113's 
actions over the next few years. 

The goal of this Survey is to begin building a consen- 
sus among members of the nano-electrotechnology 
community on a framework leading to standards devel- 
opment. Your responses to this survey will help the 
IEC TC 113 set priorities. Specifically, the TC 113 
wishes to: 

1) Set procedures for ranking new documents for com- 
ment (DC) and new work item proposals (NWIPs) in 
priority order; 

2) Identify members for work groups to improve DCs 
and complete high priority NWIPs; and 

3) Respond to DCs and NWIPs from IEC National 
Committees. 

We invite all members of the nano-electrotechnology 
community to complete this Web-based survey within 
two weeks (DATE). This survey should take you about 
8 minutes to complete. 
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Governing Principles 

I. Nano-electrotechnologies are very diverse and 
multidisciplinary. lEC TC 113 members plan to use the 
Survey to: 

• Build a consensus on key challenges to society 
for nano-electrotechnology implementation and 
international markets. Possible examples 
include energy, healthcare, environment, 
emergency response, security, and multimedia 
communications . 

• Select technologies for responding to new work 
items proposals on nano-electrotechnology for 
TCllS's consideration. 

II. Present resources are not adequate to address 
simultaneously all of the fields of interest to TC 113 as 
cited in the May 2007 lEC E-TECH article, 
http ://ww w. iec . ch/online_news/etech/arch_2007/etech 
_05 07/spotlight .htm ?mlref =etech 

Fields of interest to TC 113 cited therein are: 



Performance and reliability assessment for 
nanoelectronics 

Analytical equipment and techniques for meas- 
urement of electrotechnical properties 
Fabrication tools for integrated circuits (elec- 
tronic, photonic, and optoelectronic) 
Nano structured sensors 
Nano-electronics, materials and devices 
Opto-electronics 
Optical materials and devices 
Organic (Opto) electronics 
Magnetic materials and devices 
Radio frequency devices, components and 
systems 

Electrodes with nano- structured surfaces 
Electrotechnical properties of nano-tubes 
/nanowires 
Fuel cells 
Bioelectronic applications. 



III. According to the IEC mission statement 
(http://www.iec.ch/about/mission-e.htm) the standardi- 
zation efforts of TC 113 may include all electrotech- 
nologies such as electronics, magnetics and electro- 
magnetics, electroacoustics, multimedia, telecommuni- 
cation, and energy production and distribution, as well 
as associated general disciplines as follows: 



• Terminology, Nomenclature, and Symbols 

• Design and Development 

• Measurement and Characterization 

• Performance Assessment 

• Dependability and Reliability 

• Electromagnetic Compatibility 

• Safety and Environment 

IV. The linear economic model for innovation in 
nano-electrotechnologies has the following six stages: 

• Research 

• Development 

• Initial deployment 

• Commercialization (large-scale, high- volume 
manufacturing) 

• End use by the customers- consumers 

• End-of-life (disposing and recycling) 

If you have comments on the completeness or rele- 
vance of principles I-IV please include them here. 

Demographics 

How would you describe the nature of your work in 
nano- electrotechnologies ? 
Check only one. 



1. 

2. 
3. 
4. 
5. 

6. 

7. 



Technical R&D 

Technical Manufacturing 
Management of R&D 



Management of Manufacturing 

Standards Developer, Administrator, or Director 



Strategic Planner and Market Analyst 
Other - Please be more specific 



What is the type of institution where you are 

employed? 

Check only one. 



1. 

2. 
3. 
4. 
5. 
6. 
7. 



10. 
11. 



Manufacturing Company 

University 

Government 



Trade Association 

Investment Bank 

Metrology Organization 

Standards Developing Organization 

Legal Organization 

Non-Profit Organization 

Research Institution 



Other - Please be more specific 
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Please select your country of primary employment in 
the list below: 

Argentina 

Australia 

Austria 

Brazil 

Canada 

Czech Republic 

Denmark 

Finland 

France 

Germany 

Hungary 

India 

Indonesia 

Italy 

Japan 

Korea, Republic of 

Malaysia 

Mexico 

Netherlands 

Poland 

Portugal 

Russian Federation 

Singapore 

Spain 

Sweden 

United Kingdom 

United States of America 

If your country of primary employment is not listed, 
please specify in the text box below: 
{textbox} 

Nano-Electrotechnology Properties 



Nano-Electrotechnology Taxonomy: Products 

Please rank the following TC 113 taxonomy cate- 
gories in numerical priority order from 1 to 8, where 1 
is most significant, i.e., the most important in terms of 
enabling innovations at the nanoscale. Please do not 
assign the same numerical order to more than one 
taxonomy category. 



Products 

Priority _ 



Computers (PDA and similar, laptop, 

desktop, mainframe) and Computer Peripherals (print- 
ers, monitors/displays, etc.) 

Priority Multimedia Consumer Electronics 

Priority Telecommunication and data commu- 
nications (wireless and wired-physical connection) 

Priority Energy (Production, Conversion, and 

Storage) 

Priority Medical Products 

Priority Security and Emergency Response 

Devices and Applications 

Priority Household and Consumer Applications 

Priority Transportation (SeaAVater, Ground, 

Air, and Space) 

Optional: Are there any other taxonomy categories not 
covered by the above list that would be appropriate for 
TC 113 to consider? If so, please cite unique categories 
that are not contained within the ones listed above and 
indicate where they rank relative to your ranking of the 
eight taxonomy categories listed above. For example: 
before 1, between 1 and 2, 2 and 3, 3 and 4..., or after 8. 
{ comment box } 

Nano-Electrotechnology Taxonomy: Cross-Cutting 
Technologies 



Please rank the following nano-electrotechnology 
properties of concern to TC 113 in numerical priority 
order from 1 to 6, where 1 is most important property 
for TC 113 members to consider first. Please do not 
assign the same numerical order to more than one tax- 
onomy category. 



Please rank the following TC 113 taxonomy 
categories in numerical priority order from 1 to 8, 
where 1 is most significant, i.e., the most important in 
terms of enabling innovations at the nanoscale. Please 
do not assign the same numerical order to more than 
one taxonomy category. 



Priority . 
Priority . 
Priority . 
Priority . 
Priority . 
Priority . 



. Electronic and Electrical 

. Optical 

. Magnetic 

. Radio Frequency 

. Chemical 

. Biological 



Priority_ 



Performance and reliability assessment 



for nanoelectronics 

Priority Analytical equipment and techniques 

for measurement of electro-technical properties 

Priority Fabrication tools for integrated circuits 

(electronic, photonic, optoelectronic, and mechanical) 
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Priority 



Optical Technologies (Optoelectronics 



and Illumination) 

Priority Environmental, Health, and Safety 

(EH&S) Applications and Effects 

Priority Instrumentation (Test Equipment and 

Industrial Process Control for Use in Fabrication) 

Priority Nano-electromechanical systems 

Priority Sensors (chemical, physical, mechani- 
cal, etc.) 

Optional: Are there any other taxonomy categories not 
covered by the above list that would be appropriate for 
TC 113 to consider? If so, please cite unique categories 
that are not contained within the ones listed above and 
indicate where they rank relative to your ranking of the 
eight taxonomy categories listed above. For example: 
before 1, between 1 and 2, 2 and 3, 3 and 4. . ., or after 8. 
{comment box} 

lEC General Discipline Areas 

Considering the lEC General Discipline Areas for 
nano-electro-technologies given in the lEC Mission 
Statement (Governing Assumption III), please rank 
them in numerical priority order from 1 to 6, where 1 is 
most significant for TC 113 members to consider first. 
Please do not assign the same numerical order to more 
than one focus area. 



Priority . 
Priority . 
Priority . 
Priority . 
Priority . 
Priority . 



. Terminology and Symbols 
. Design and Development 
. Measurement and Performance 
. Dependability and Reliability 
. Electromagnetic Compatibility 
. Health, Safety and Environment 



Stages of the Economic Model 

Considering the stages of the economic model, 
please rank them in numerical priority order from 
1 to 6, where 1 is most significant for TC 113 members 
to consider first (i.e., where standards are required). 
Please do not assign the same numerical order to more 
than one focus area. 



Priority 

Priority 

development) 

Priority 

Priority 



Basic Technical Research 
Technology Development (prototype 

. Initial Deployment 
Commercialization (large-scale, high 



volume manufacturing) 

Priority End use by the customer-consumer 

Priority End-of-Life (disposing and recycling) 

Additional Comments 

Optional: Please provide any additional comments 
concerning what you think should be the action items 
for the lEC TC 113 members in the near- term (1 to 3 
years), mid-term (3 to 10 years), and long-term (greater 
than 10 years). 
{ comment box } 

Potential Participation on the Work of the Technical 
Committee— lEC TC 113 

1. Would you be willing to serve as an expert 
contributing to the lEC TC 113 — Nanotech- 
nology standardization for electrical and 
electronic products and systems on nanotech- 
nology? 

a. If no, go straight to 2. 

b. If yes, please continue: 

An lEC member is called a National Committee 
(NC), and each NC represents its nation's electrotech- 
nical interests in lEC management and standardization 
work. 

If you are in a country that already participates in 
the work of the lEC TC 113, or has Observer status, 
please email the Secretary for your NC directly by 
clicking on the appropriate links in the TC 113 Country 
Table below. The country information will open in a 
separate window. After sending the e-mail to the 
Secretary of your NC, you will have to use your 
browser to close the page in order to return to continue 
the survey. 
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Country 


Country Code 


P/O Status 




Argentina 


AR 


Observer 


Australia 


AU 


Observer 


Austria 


AT 


Observer 


Brazil 


BR 


Observer 


Canada 


CA 


Participant 


Czech Republic 


CZ 


Observer 


Denmark 


DK 


Observer 


Finland 


n 


Participant 


France 


FR 


Participant 


Germany 


DE 


Participant 


Hungary 


HU 


Observer 


India 


IN 


Observer 


Indonesia 


ID 


Observer 


Italy 


IT 


Participant 


Japan 


JP 


Participant 


Korea, Republic of 


KR 


Participant 


Malaysia 


MY 


Participant 


Mexico 


MX 


Observer 


Netherlands 


NL 


Observer 


Poland 


PL 


Observer 


Portugal 


PT 


Observer 


Russian Federation 


RU 


Participant 


Singapore 


SG 


Participant 


Spain 


ES 


Participant 


Sweden 


SE 


Participant 


United Kingdom 


GB 


Participant 


United States of America 


US 


Participant 



Acronyms 

ANSI American National Standards Institute 

DC Documents for comment 

EEEL Electronics and Electrical Engineering Laboratory (NIST) 

lEC International Electrotechnical Commission (web link) 

NC National Committee (country lEC member) 

NEMS Nanoelectromechanical Systems 

NIST National Institute of Standards and Technology 

NWIP New Work Item Proposal (proposal for the preparation of 
a standard or a series of related standards in the field cov- 
ered by an existing technical committee of ISO or lEC. 
The proposer of the NWIP is a national committee, for the 
US it is ANSI.) 

TC 113 Nanotechnology standardization for electrical and elec- 
tronic products and systems (lEC TC 113) 

We thank you for completing this Survey. 



c. If your country is not listed in the above table, 
please e-mail the lEC TC 113 Secretary 
Dr. Norbert Frabricius, at 

Norbert.Fabricius@nanomikro.fzk.de for infor- 
mation to contact your National Committee or to 
participate as an individual expert if your country 
does not have an lEC National Committee. 

We thank you for taking advantage of this unique 
opportunity to contribute to and harmonize nano- 
electro-technology standardization efforts worldwide. 
We will further appreciate your contributions if you 
volunteered to serve as an expert. Please include your 
e-mail address if you would like to receive an e-mail 
notice with a link to download a copy of the report for 
this survey. A copy of your responses will be e-mailed 
to you. 
{ textbox } 



Appendix B: 



Statistical Formulas and 
Quartiles and Medians 



This first part of this Appendix is based on general- 
izing the equations in Appendix A of reference 7 for the 
cases in this Survey. The second part of this Appendix 
is based on documenting how the software that we use 
computes medians and quartiles. 

Part 1 - Statistical Formulas 

We treat the ranks as an ordinal variable and use the 
median as an estimate of the central tendency [8]. The 
95 % confidence interval for r^ is [r^o^er * ''upper 1 defined as 



Am'=l.51{r^-r^)l4N 
^upper :=min{r^+A/77,r3} 
nower :=max{r^-Am,ri} 



(B.l) 



where r^ is the median rank, r^ and r^ are the 3rd and 
1^/ quartile ranks, and A^ is the number of respondents. 
In other words, the confidence interval is symmetric 
about the median. When the interval extends beyond 
the quartile, we use the interval value and not the quar- 
tile value in the Figures. 
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We follow Lehmann [9] for computing the 
Friedman's statistic. Because the Survey has n^ items 
for each category type / (i.e., "treatments") and repeat 
rankings are not allowed, if one assumes Hq is true, then 
the mean item rank is (n^- l)/2. Friedman's statistic is 
the scaled sum of squared differences. 



Q 



12N 



«,.(«,. +1) 



1^(5 -[(«,. +l)/2])'. (B.2) 



Here A'^ is the number of respondents and R ^ is the 
mean of the ^-th item. We reject Hq for large values of 
Q. Under the normalization (B.2), the large A'^ asymp- 
totic distribution for 2 is a chi-square variate with 
d = (n^- 1) degrees of freedom, x^d- ^^ this paper, we 
consider only those subcategories of respondents for 
which A'^ is sufficiently large that this asymptotic distri- 
bution is valid [12]. 

We compute confidence /7-values as follows. In place 
of 2, for consistency across different size groups, we 
report Kendall's W, 



Minitab 

Quartiles: In Minitab (http://www.minitab.com/), after 
the data is arranged in ascending order, the first (Q^) 
and third (Q3) quartiles are determined by the following 
equations: 



Qi=(n + l)/4, 
Q3=3(/2 + l)/4, 



(B.5) 



W:=QINin.-\). 



(B.3) 



where n is the number of observations in the data set. 
For example, in a data set with 184 observations, 
Qi = (184+ l)/4 = 46.25. Since Qi is not an integer, 
interpolation is used to determine the value ygi for the 
first quartile using the 46th and 47th observations in the 
ordered data set. If Q^ had been an integer, y<^y would be 
the value associated with the Q^. In the data set of this 
example, the values in the 46th and 47th observations 
are 2 and 3, respectively. Through interpolation, the 
value that Minitab produces for the first quartile is 2.25. 
The interpolation is as follows: 



This rescaling of Q is such that < W < 1 . Kendall and 
Smith [13] provide other interpretations of W. 

As an example, using the data of Table 6, we 
compute Qaii= 182.41 and the associated \F„;; = 0.0568 
(A^= 459 for all survey respondents). Using the comple- 
mentary cumulative distribution function of a x^d 
random variable, the probability of observing Q>Q^ii 
when Hq is true is computed by. 



Pall=^-F.liQ<.ll)=^ 



Xd 



(B.4) 



In this example Q^n = 182.41 is sufficiently large that 
p^i is effectively zero. Because the probability of 
observing Q^n (or higher) when Hq is true is extremely 
small, we may then assert that Hq is false. 

Part 2 - Quartiles and Median 



Yqi = Yo + (x - Xo)[(yi - yo)/(Xi - Xq)], 

where, 

y^^ = value to be determined, 

yo = value in the 46th observation = 2, 

yi = value in the 47th observation = 3, 

x = Q, = 46.25, 

Xq = integer observation below Qi = 46, 

Xi = integer observation above Q^ = 47 



Substituting the values in the above ordered data set 
give: 

yQi = 2 + (46.25 - 46)*[(3 - 2)/(47 - 46)] 
= 2 + 0.25x1=2.25. 



The Survey software (SelectSurvey.NET 2.8.7) pro- 
duces an Excel file that contains the raw data for the 
459 completed responses. This file also can be used for 
input into Minitab. We use Excel in Microsoft Office 
2003 SP3 to compute Friedman's statistic g, Kendall's 
W, quartiles, and medians. We use Minitab Release 
14.1 to compute confidence /?- values and to verify the 
Friedman's statistic Q from Excel. 



Median: In Minitab, if n is odd, the median is the value 
in the middle of a data set organized in ascending order. 
If n is even, the median is the average of the two 
middle values. For a data set where n=lS4 and the two 
values in the middle, the 92nd and 93rd observations, 
are 4 and 5 respectively, Minitab averages these two 
values to produce a median of 4.5. 
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Excel 

Excel determines Q^, Q3, and the median in a some- 
what different manner than Minitab, which may pro- 
duce different results. 

Quartiles: With the data arranged in ascending order, 
Excel computes the quartiles by the following equa- 
tions: 



Qi 
Q3 



:(n + 3)/4, 
= (3n + l)/4. 



(B.6) 



Thus, using the above example where n = 184 gives 
Qi = (184 + 3)/4 = 46.75. Interpolation is still used to 
determine the quartile values when the resulting obser- 
vation is not an integer. Therefore, using the foregoing 
data set. Excel produces the following result for yQ^: 



yQ, = 2 + (46.75-46)*[(3- 
= 2 + 0.75 X 1 = 2.75 . 



2)/(47 - 46)] 



This value is different from Minitab's 2.25 for yg^. 

Median: In Excel, the middle position Q2 is determined 
by following equation: 

Q2=(^+l)/2. 

Therefore, when n = 184, Q2 = (184 + l)/2 = 92.5. As 
with the first and third quartiles. Excel interpolates for 
the median value when the resulting observation is not 
an integer. Using the foregoing data set gives: 

yQ2 = 4 + (92.5 - 92)*[(5 - 4)/(93 - 92)] 
= 4 + 0.5x1=4.5. 

This value is the same as that produced by Minitab for 
the median value. 
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